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DETAILED ACTION 



Priority 

1 . Receipt is acknowledged of papers submitted under 35 U.S.C. 1 19(a)-(d), which 
papers have been placed of record in the file. 

Speciffcation 

2. The disclosure is objected to because of the following informalities: 
At page 38, line 2, "an data" should be -a data-. 

Appropriate correction is required. 



Claim Suggestions 



3. In claim 16, line 2, "an image to be displayed generating condition" should be 
replaced with -a condition applied on the image for display--. 

4. In claim 16, line 8, "one of the image to be displayed generating condition" should 
be replaced with -a condition applied on the image for display-. 

5. In claim 16, line 9, "storage section and data" should be replaced with -storage 
section or data". 
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6. In claim 20, line 4, "into predetermined area" should be -into a predetermined 
area--. 

7. In claim 22, line 3, "recognizing subject area" should be -recognizes a subject 
area-. 

8. In claim 26, line 2, "an other modality image" should be - an other another 
modality image-. 

9. In claim 39, line 3, "recognizes subject area" should be -recognizes the subject 
area-. 

Claim Objections 

10. Claims 1 1 and 20 are objected to because of the following informalities: 

In claim 11, line 2, "performs image measurement" should be -performs an 
image measurement-. 

Appropriate correction is required. 

1 1 . The following is a quotation of 37 CFR 1 .75(a): 

The specification must conclude with a claim particularly pointing out and distinctly claiming the subject 
matter which the applicant regards as his invention or discovery. 

1 2. Claims 4, 5, 24 and 42 are objected to under 37 CFR 1 .75(a), as failing to 
particularly point out and distinctly claim the subject'matter which application regards as 
his invention or discovery. 
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Claim 4 recites "the image processing condition" in line 1 and line 3. It is unclear 
whether this is intended to be the same as or different from the "image processing 
condition" recited in line 2 of claim 3 or the "image processing condition" in line 3 or 
claim 3. The following will be assumed for examination purposes: "the image 
processing condition for the sub image". This also applies to lines 1 and 3 of claim 5. 

Claim 24 lacks antecedent basis for "the diagnosis aid" in line 1 . Claim 24 will be 
assumed to depend from claim 2 for examination purposes, because claim 2 provides 
the necessary antecedent basis for a diagnosis aid. The following will be assumed for 
examination purposes: "The system of claim 4 2,". 

Claim 42 lacks antecedent basis for "the image processing device" in line 6. The 
following will be assumed for examination purposes: "the image processing device 
section". 



Claim Rejections - 35 USC § 102 



13. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(a) the invention was known or used by others in this country, or patented or described in a printed 
publication in this or a foreign country, before the invention thereof by the applicant for a patent. 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

(e) the invention was described in (1) an application for patent; published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
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351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

14. Claims 1-3, 7, 9, 1 1 , 13-16. 24 and 45 are rejected under 35 U.S.C. 102(b) as 
being anticipated by Wang (US 6,434.262). 

Regarding claims 1 and 45, Wang discloses medical image processing system 
and method ("system and method for detection and identification of abnormalities in 
radiological images" at col. 1, line 25) comprising 

an image processing section (portion of CAD system 20 that performs steps 50 
and 72 in figure 5) for performing image processing including at least gradation 
processing ("convert the low-contrast radiological image to a high-contrast image" at 
col. 12. line 12) on a medical image (figure 5, numeral 40), 

a display formatting section ("CAD system 20, which can be a part of unit 72" at 
col. 12. line 39) for transforming the medical image processed in order to generate an 
image to be displayed ("CAD system determines how the digital, wide-latitude 
radiogram 800 should be printed on a photographic film" at col. 12, line 48), and 

an image output section ("output display section of the system for display" at col. 
6, line 25) for outputting the image to be displayed to an image recording device (figure 
5, numeral 580), 

wherein the image processing section generates, based on at least one medical 
image obtained by radiographing a subject (figure 5, numeral 600), a plurality of 
processed images composed of at least one main image (figure 5. numeral 55) and at 
least one sub image generated by reducing the whole of the at least one medical image 
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(figure 5, numerals 66, 67), and the display formatting section generates one image 
(figure 3, numeral 450) to be displayed by synthesizing the main image and the sub 
image ("annotation road map 58, the enhanced image tiles 66 and 67, and the digital 
mammogram 40 are all displayed on the same TV monitor** at col. 9, line 18). 

Regarding claim 2, Wang discloses a system further comprising a diagnosis aid 
information generating section (figure 5, numeral 50) for generating diagnosis aid 
information (figure 5, numerals 56 and 57; "CAD-detected abnormalities 56 and 57" at 
col. 5, line 66) by analyzing the medical image, wherein the display formatting section 
adds annotation ("annotated road maps 58 and the enhanced image tiles 66 and 67 can 
also be printed at the edge or margin of the mammogram 650" at col. 1 , line 54) 
corresponding to the diagnosis aid information generated by the diagnosis aid 
information generating section to the at least one sub image (figure 5, numeral 58). 

Regarding claim 3, Wang discloses a system wherein the image processing 
section determines an image processing condition for the main image ("annotation map 

55 can be scaled down to a sub-sampled image at col. 6, line 8) and an image 
processing condition for the sub image ("generated by further image processing the 
regions in the digitized image 40 which correspond to the CAD detected abnormalities 

56 and 57" at col. 6, line 16) respectively by analyzing the medical image, and 
generates the plurality of processed images composed of the at least one main image 
and the at least one sub image by using the image processing conditions determined 
(figure 3, numeral 450; figure 5, numeral 650). 
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Regarding claim 11, Wang discloses a system wherein the diagnosis aid 
information generating section performs an image measurement on the medical image 
("abnormal feature detection algorithms used in the abnormal feature detection stage" at 
col. 6, line 44), and generates the diagnosis aid information including location 
information in regard to a result of the image measurement in the medical image 
("emphasize the abnormal features of the CAD detected abnormalities" at col. 6, line 
46). 

Regarding claim 14, Wang discloses a system further comprising a diagnosis aid 
information storage section (figure 5, numeral 70; "memory storage unit 70") for storing 
the diagnosis aid information as related to image data of the medical image ("annotation 
map 55, the miniaturized annotated road map image 58, the enhanced image tiles 66 
and 67... can be stored for later use" at col. 6, line 19), wherein the display formatting 
section loads the diagnosis aid information stored in the diagnosis aid information 
storage section ("annotated road maps 58 and the enhanced image tiles 66 and 67 can 
also be printed at the edge or margin of the mammogram 650" at col. 1 , line 54), and 
generates the image to be displayed on the basis of the diagnosis aid information 
(figure 5, numeral 650). 

Regarding claim 24, Wang discloses a system wherein the diagnosis aid 
information generating section generates a plurality of pieces of diagnosis aid 
information different from one another based on the same medical image (figure 5, 
numerals 66, 67), and the image processing section generates the at least one sub 



Application/Control Number: 10/764,413 Page 8 

Art Unit: 2609 

image per each of the plurality of pieces of diagnosis aid information (figure 5, numerals 
56, 57; figure 5, numerals 66, 67). 

Regarding claim 7, Wang discloses a system further comprising an image 
recording device infomnation storage section ("output display section" at col. 9, line 8) 
for storing image recording device information corresponding to the image recording 
device ("guide into two different display media the display resulting from converting a 
low-contrast image into a high-contrast image where needed" at col. 12, line 40), 
wherein the image processing section determines an image processing condition based 
on an analysis result of the medical image ("uses information regarding the suspected 
abnormalities that were automatically found by unit 50 to automatically convert the low- 
contrast radiological image to a high-contrast image" at col. 12, line 10) and the image 
recording device information ("switch 71 is set to send the low-contrast, wide latitude 
radiological image and information about the suspected abnormalities through a 
processor 72" at col. 12, line 4). 

Regarding claim 9, Wang discloses a system further comprising a sub image 
display assigning information input section ("toggle switch" at col. 7, line 17) for 
externally inputting information in order to assign whether the sub image is to be 
displayed or not ("enhanced image tiles 66 and 67 can also be toggled (switch not 
shown) on and off' at col. 9, line 26), wherein the display formatting section generates 
the image to be displayed with the sub image displayed or an image to be displayed 
without the sub image displayed on the basis of the sub image display assigning 
information inputted externally ("annotation road map 58 may alternatively be displayed 
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by overlaying it on top of the digital mammogram 40. This overlay may be toggled 
(switch not shown) on and ofF' at col. 9, line 22). 

Regarding claim 13, Wang discloses a system further comprising 

an image display section for displaying on a monitor, the image to be displayed 
generated by the display formatting section (figure 5, numeral 900); 

an image to be displayed modifying information input section ("toggle switch" at 
col. 7, line 17) for externally inputting modifying infomiation for modifying the image to 
be displayed ("enhanced image tiles 66 and 67 can also be toggled (switch not shown) 
on and off' at col. 9, line 26); and 

a display image modifying section for modifying the image to be displayed on the 
basis of the image to be displayed modifying information inputted externally ("annotation 
road map 58 may alternatively be displayed by overlaying it on top of the digital 
mammogram 40. This overlay may be toggled (switch not shown) on and off' at col. 9, 
line 22). 

Regarding claim 15, Wang discloses a system further comprising an image 
processing condition storage section (figure 5, numeral 72) for storing an image 
processing condition of image processing as related to image data of the medical image 
("automatically convert the low-contrast radiological image to a high-contrast image at 
the density range(s) corresponding to the abnormalities" at col. 12, line 12), the image 
processing performed on the medical image by the image processing section, 

wherein the image processing section loads the image processing condition 
stored in the image processing condition storage section ("CAD system 20, which can 
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be a part of unit 72 in FIG. 5, is used guide into two different display media" at coL 12, 
line 39), and generates the plurality of processed images on the basis of the image 
processing condition. 

Regarding claim 16, Wang discloses a system further comprising a display 
format storage section (figure 5, numeral 70; "memory storage unit 70") for storing a 
condition applied on the image for display applied on the medical image by the display 
formatting section, or image data of the image to be displayed generated by the display 
formatting section, as related to image data of the medical image ("CAD system 
determines how the digital, wide-latitude radiogram 800 should be printed on a 
photographic film" at col. 12, line 48) 

wherein the display formatting section loads at least a condition applied on the 
image for display stored in the display format storage section or data of the image to be 
displayed in order to generate the image to be displayed ("transferred to an output 
display section of the system for display" at col. 6, line 25). 



Claim Rejections - 35 USC § 103 



15. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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16. Claims 4 and 5 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
the combination of Wang and Kim et al. (US 5.963,665). 

Wang teaches the system of claim 1 including the image processing condition 
and the image processing section. 

Wang does not teach that the image processing condition includes a gradation 
processing condition, and detemnining the gradation processing condition so as to make 
an average gradient of the sub image smaller than an average gradient of the main 
image or have an opposite sign value to a value of an average gradient of the main 
image. 

Kim discloses an image processing condition that includes a gradation 
processing condition ("contrast of the image is enhanced" at col. 2, line 16), and 
determining the gradation processing condition so as to make an average gradient of 
the sub image smaller than an average gradient of the main image and have an 
opposite sign value to a value of an average gradient of the main image ("input samples 
which are equal to or less than the mean level Xm are mapped into a gray level of from 
0 to Bm" at col. 5, line 25; figures 4A. 4B. 5A and 5B). 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art for the image processing condition of Wang to include and determine the 
gradation condition of Kim as described above, such that "the mean brightness of the 
given image is preserved while the contrast of the image is enhanced" (Kim at col. 2, 
linel). 
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17. Claim 6 is rejected under 35 U.S.C. 103(a) as being unpatentable over the 
combination of Wang and Hirayama (US 7,054,036). 

Wang teaches the system of claim 1 including the image processing condition 
and the image processing section. 

Wang does not teach that the image processing condition includes a frequency 
processing condition and determining the frequency processing condition so as to make 
low frequency components of the sub image have smaller amount than low frequency 
components of the main image. 

Hirayama discloses an image processing condition that includes a frequency 
processing condition ("degree of sharpness is adjusted" at col. 7, line 52) and 
determining the frequency processing condition so as to make low frequency 
components of the sub image have smaller amount than low frequency components of 
the main image ("vary the sharpness in units of an area" at col. 8. line 3; "increase or 
decrease the sharpness" at col. 7, line 61). 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art for the image processing condition of Wang to include and determine the 
frequency condition of Hirayama as described above, in order "to provide an image 
processing method and an image forming apparatus capable of achieving a high image 
quality" (Hirayama at col. 1, line 32). 

18. Claims 8 and 17 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
the combination of Wang and Kupinski et al. (US 6,138,045). 
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Wang teaches the system of claim 1 including the image processing section for 
analyzing the medical image and generating the at least one sub image and a display 
formatting section that loads the image data stored in order to generate the image to be 
displayed on the basis of the image data. 

Wang does not teach a schema image generating section for automatically 
generating a schema and the at least one sub image including the schema and a 
schema image storage section for storing image data of the schema. 

Kupinski teaches a schema image generating section ("processor 320" at col. 12. 
line 1) for automatically generating a schema (figure 1, "generate contours"; figures 8A, 
and 8B) and the at least one sub image including the schema ("sub-image or region of 
interest (ROI) of dimension n by m containing the suspect lesion" at col. 5, line 1 1 ) and 
a schema image storage section ('a hard disk 310" at col. 1 1 , line 62) for storing image 
data of the schema ("Such computer readable media further includes programming or 
software instructions to direct the general purpose computer 300 to perform tasks in 
accordance with the present invention" at col. 12, line 15). 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to modify the image processing unit of Wang using the contour generation 
taught by Kupinski as described above, for "improved computerized segmentation and 
discrimination of lesions" (Kupinski at col. 1 , line 16). 

19. Claim 12 is rejected under 35 U.S.C. 103(a) as being unpatentable over the 
combination of Wang and Lobiondo (US 5.287.194). 
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Wang teaches an output channel selecting section ("switch 73" at col. 12, line 18) 
for selecting any one annong the plurality of output channels to which an image is 
outputted; and an image recording device information storage section for storing image 
recording device information of the image recording device set per each of the output 
channels, the display formatting section generates the image to be displayed on the 
basis of the image recording device information which corresponds to the output 
channel selected by the output channel selecting section, and which is stored in the 
image recording device information storage section. 

Wang does not teach a plurality of image recording devices. 

Lobiondo teaches a plurality of image recording devices ("multiple printers 10 for 
a single job, among a plurality of local and remote printers 10 attached to the network" 
at col. 4, line 17). 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to modify the image output section of Wang using the multiple printer 
network taught by Lobiondo as described above, to "take full advantage of the printer 
systems capacities" (Lobiondo at col. 4, line 21 ). 

20. Claims 10. 25. 26-30, 38 and 41 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over the combination of Wang and Takeo et al. (US 2002/0041702). 

Regarding claims 10, 25 and 28, Wang discloses a system further comprising 
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a modality for generating the medical image by radiographing the subject 
("mammographic x-ray film acquired with a conventional mammographic film-screen 
imaging system" at col. 5, line 31), 

a synthesized image generating section for recognizing subject area of the main 
image generated and for locating at least one of the reduced medical image and the 
reduced abnormality displayed image with information of the subject area recognized in 
the main image maintained in order to synthesize the main image with at least one of 
the reduced medical image and the reduced abnormality displayed image as the sub 
image into a synthesized image ("annotation road map 58 and the enhanced image tiles 
66 and 67 are shown in FIG. 4 placed at the same edge or margin of the printout film as 
the patient Information label 12" at col. 9, line 41 ), 

wherein the image processing section comprises a reduced medical image 
generating section (portion of CAD system 20 that performs steps 50 and 72 in figure 5) 
for reducing at a predetermined magnifying rate ("annotation map 55 can be scaled 
down to a sub-sampled image, say 512 x 512 pixel in size and 8-bit in gray scale, of the 
digitized image 40" at col. 6, line 8), the whole of the medical image, in order to 
generate a reduced medical image as the sub image, and the display fomriatting section 
comprises: 

a reduced abnormality displayed image generating section ("CAD system 20, 
which can be a part of unit 72" at col. 12, line 39) for overlapping at least annotation 
information as the result of the detection of the abnormal candidate in order to generate 
the reduced abnormality displayed image on the reduced medical image generated by 



Application/Control Number: 10/764,413 Page 16 

Art Unit: 2609 

the reduced medical image generating section, the annotation information indicating a 
location of the abnormal candidate ("annotated road maps 58 and the enhanced image 
tiles 66 and 67 can also be printed at the edge or margin of the mammogram 650" at 
col. 1, line 54); and 

wherein the diagnosis aid information generating section detects abnormalities in 
the medical image and generates the diagnosis aid information including location 
information in regard to the abnormalities detected in the medical image. 

Wang does not teach detecting an abnormal shadow candidate, generating 
location information in regard to the abnormal shadow candidate and overlapping 
annotation information as a result of the detection of the abnormal shadow candidate on 
the image. 

Takeo discloses a system wherein an abnormal shadow candidate is detected 
(figure 8, numeral 30) and location information in regard to the abnormal shadow 
candidate is generated and overlapping a result of the detection of the abnormal 
shadow candidate on the image (figure la). 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to modify the abnormal feature detection unit of Wang using the shadow 
detection means taught by Takeo as described above, such that "stable detection 
capability can be obtained regardless of differences between the image obtaining 
environments of said facilities" (Takeo at paragraph 0071, line 11). 

Regarding claim 26, Wang discloses a system further comprising an obtaining 
section (figure 5, numeral 15) for obtaining at least one of another modality image of the 
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same radiographic part of the same subject, generated by a modality other than the 
modality that has generated the medical image ("magnetic resonance imaging ("MRI") 
systems, computed tomography ("CT") systems, ultrasound imaging systems" at col. 8, 
line 28) and a past medical image generated by the same modality (a previously printed 
film can be inputted into the CAD system); and 

an obtained image storage section (figure 4, numeral 70) for storing at least one 
of the other modality image obtained and the past medical image obtained ("annotation 
map 55, the miniaturized annotated road map image 58, the enhanced image tiles 66 
and 67... can be stored for later use" at col. 6, line 19), 

wherein the image processing section comprises an obtained image processing 
section (portion of CAD system 20 that performs steps 50 and 72 in figure 5) for loading 
at least one of the other modality image and the past medical image from the obtained 
image storage section, and for reducing at the predetermined magnifying rate, the 
image loaded in order to generate the reduced medical image as the sub image, and 

at least one of the reduced medical image and the reduced abnormality 
displayed image to be synthesized with the main image by the synthesized image 
generating section is any one of the images indicated by the following items (1) to (5), 
(1) a reduced medical image of the same medical image as the main image; (2) a 
reduced abnormality displayed image of the same medical image as the main image; 
(3) a reduced medical image of another medical image related to the medical image of 
the main image; (4) a reduced abnormality displayed image of another medical image 
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related to the medical image of the main image; and (5) a reduced medical image 
obtained from the obtained image processing section. 

Regarding claim 27, Wang discloses a system wherein the obtained image 
processing section performs at least one among gradation processing, frequency 
processing and processing for adding information indicating a modality type in an 
image, on the reduced other modality image. 

Regarding claim 30, Wang discloses a system wherein the obtained image 
processing section further analyzes at least one of the other modality image reduced 
and the past medical image reduced in order to recognize each subject area, and 
performs density correction so as to make area other than the each subject area 
recognized have more than predetermined density. 

Regarding claim 29, Wang discloses a system wherein the reduced image 
generating section further recognizes the subject area by analyzing the reduced medical 
image ("around the CAD detected abnormality 890, say around relative exposure 30, is 
provided at the optimum contrast gradient (say G=3.0) while other image content, above 
or below the exposure range of the CAD detected abnormality 890, are compressed in 
display latitude and are displayed with reduced contrast gradient" at col. 12, line 59), 
and performs density correction so as to make area other than the subject area 
recognized have more than predetermined density (figure 5, numeral 72). 

Regarding claim 38, Wang discloses a system wherein when at least one of a 
plurality of the reduced medical images and a plurality of the reduced abnomiality 
displayed images are synthesized with the main image, the synthesized image 
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generating section performs size adjustment on each of the images to be synthesized 
with the main image so as to make the image to be synthesized have the same size 
(figure 5, numeral 600; "Enhanced image tiles 66 and 67, centered respectively around 
the CAD-detected abnormalities 56 and 57. say 512 x 512 pixel" at coL 8, line 64). 

Regarding claim 41, Wang discloses a system further comprising an assigning 
section (figure 1, numeral 90) for assigning whether the reduced medical image is set 
as the sub image or the reduced abnormality displayed image is set as the sub image 
("the miniaturized annotated road map 58 and the enhanced image tiles 66 and 67 are 
alternatively or sequentially displayed as images 300x, by operating a toggle switch" at 
col. 7, line 15). 

21 . Claims 18-22 and 37 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over the combination of Wang and Nelson (US 6,381,352). 

Wang teaches an image size adjusting section (portion of CAD system 20 that 
performs steps 50 and 72 in figure 5) for performing size adjustment on the main Image 
("annotation map 55 can be scaled down to a sub-sampled image at col. 6. line 8) 
wherein the image size adjusting section performs the size adjustment so as to make an 
image size of the sub image smaller than an image size of the main image. 

and an image synthesizing section for synthesizing the main image and the sub 
image so as to fit the sub image into a predetermined area in the main image wherein 
the location for fitting the sub image is determined on the basis of image attribute 
information of the medical image (figure 5. numeral 650) according to a ratio between 
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the subject area and area other than the subject area in the main image ("Enhanced 
image tiles 66 and 67, centered respectively around the CAD-detected abnormalities 56 
and 57. say 512 x 512 pixel" at col. 8, line 64; enhanced image tiles 66 and 67 are 
shown in FIG. 4 placed at the same edge or margin of the printout film as the patient 
information label 12" at col. 9, line 42) 

wherein the display formatting section comprises a subject area recognizing 
section for recognizing a subject area by analyzing the medical image, and the image 
synthesizing section determines a location into which the sub image size-adjusted is to 
be fitted on the basis of information of the subject area recognized and 

wherein the image size adjusting section adjusts the image size of the sub image 
on the basis of the information of the subject area recognized. 

Wang does not teach performing size adjustment on the sub image. 

Nelson discloses a method of performing size adjustment on the sub image 
("sub-image can then be re-scaled" at col. 2, line 1). 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to modify the size adjusting section of Wang using the resizing taught by 
Nelson as described above, such that the user can review the images "for improved 
contrast of the relevant subject matter as compared to the initial image" (Nelson at col. 
2, line 2). 
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22. Claims 31 and 32 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over the combination of Wang and Takeo as applied to claims 25 and 26 above, and 
further in view of Kallergi et al. (US 6.630.937). 

The Wang and Takeo combination discloses a reduced medical image and a 
reduced abnormality image generated by the reduced medical image generating 
section. 

The combination does not teach a size information adding section for adding at 
least one of scale calibration and information indicating a reduction ratio. 

Kallergi discloses a system comprising a size information adding section 
("appropriate buttons 413,414 on the controls" at col. 6, line 53) for adding at least one 
of scale calibration and information indicating a reduction ratio ("a measuring ruler 80" at 
col. 6, line 52; figure 8). 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to modify the user interface of Wang and Takeo using the ruler taught by 
Kallergi as described above, to provide the user with "tools that will provide 
measurements of the dimensions of a suspicious region" (Kallergi at col. 6, line 50). 

23. Claims 33-36, 39, 40 and 42 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over the combination of Wang and Takeo as applied to claim 25 above, 
and further in view of Bodicker et al. (US 2002/0193676). 

Regarding claims 33 and 34. the Wang and Takeo combination discloses a 
system wherein information inputted to the image to be displayed is outputted by the 
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image output section and a storage section for storing information as related to the 
medical image to be set as the main image. 

The combination does not teach a findings information input section for inputting 
findings information corresponding to the image to be displayed, a findings information 
adding section for adding the findings information inputted to the image to be displayed 
to be outputted by the image output section and the storage section storing information 
inputted from the findings information input section. 

Bodicker discloses a system wherein a findings information input section (figure 
1, numerals 23 and 24) for inputting findings information corresponding to the image to 
be displayed ("if the radiologist needs to perform actions during the screening 
procedure... this can be done by means of a keypad and/or keyboard" at paragraph 
0017, line 1); and 

a findings information adding section for adding the findings information inputted 
to the image to be displayed to be outputted by the image output section ("entering of 
an annotation or a diagnosis" at paragraph 0017, line 6); and 

a storage section storing information inputted from the findings information input 
section (figure 1, numeral 16). 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to modify the user interface of Wang and Takeo using the additional 
information input taught by Bodicker as described above, such that the user can review 
the images "without distraction of attention due to the complexity of the user interface" 
(Bodicker at paragraph 0010, line 5). 
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Regarding claims 35 and 36, the Wang and Takeo combination discloses a 
system herein, when the main image is mammography, the synthesized image 
generating section locates at least one of the reduced medical image as the sub image 
and the reduced abnormality displayed image as the sub image in the main image in 
order to synthesize the images. 

The combination does not teach the images being any one of the following pair 
forms: (MLO(oblique direction) -R (right breast), L(left breast)), (CC(vertical direction)-R. 
L), (CC-R, L), (MLO-R, L), (MLO-R, CC-R), (MLO-L, CC-L), (MLO-L, CC-L), and (MLO- 
R, CC-R). 

Bodicker teaches the images being any one of the following pair forms: 
(MLO(oblique direction) -R (right breast), L(left breast)), (CC(vertical direction)-R, L), 
(CC-R, L), (MLO-R, L), (MLO-R, CC-R), (MLO-L, CC-L), (MLO-L, CC-L), and (MLO-R, 
CC-R) (Table 1). 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to modify the display of Wang and Takeo using the image pairs taught by 
Bodicker as described above, to allow the user to view more diagnostically relevant 
information at once. 

Regarding claim 39, the Wang and Takeo combination discloses a system 
wherein the synthesized image generating section recognizes the subject area of the 
main image and performs synthesis so as to make relative location relation between the 
subject area recognized and at least one of the reduced medical image and the reduced 
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abnormality displayed image in the main image have the same appearance or 
symmetric appearance. 

The combination does not teach a main image composed of two images at a left 
side and a right side. 

Bodicker teaches a main image composed of two images at a left side and a right 
side (figure 5, numerals 38 and 39). 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to modify the display of Wang and Takeo using the tiling taught by 
Bodicker as described above, to allow the user to view more diagnostically relevant 
information at once. 

Regarding claims 40, and 42-44, the Wang, Takeo and Bodicker combination of 
claim 34 teaches 

at least one modality, 

a managing device for storing and managing medical images generated by the at 
least one modality as related to accompanying information thereof (Bodicker, at figure 1 , 
numeral 16), and 

a medical image set as the main image and a medical image set as the sub 
image generated in the same examination by the modality among the medical images 
stored in the managing device, 

displaying a list of the medical images extracted on a display screen as sub 
image candidates (Wang, at figure 5, 650; image tiles 66 and 67) and 
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selecting a medical image to be set as the sub image among the sub image 
candidates displayed ("the enhanced image tiles 66 and 67 are alternatively or 
sequentially displayed as images 300x, by operating a toggle switch", Wang at col. 7, 
line 16). 

The combination does not teach a selecting section for selecting the images from 
among a plurality of medical images generated under different radiographing conditions 
wherein the selecting section is capable of selecting a plurality of sub images 
corresponding to the main image and extracts medical images related to the main 
image from at least one of the medical images generated by the at least one modality 
and the medical images stored in the managing device on the basis of the 
accompanying information. 

Bodicker further teaches a selecting section ("user can select an icon by clicking 
on it" at paragraph 0012, line 5) for selecting the images from among a plurality of 
medical images generated under different radiographing conditions (Table 1) wherein 
the selecting section is capable of selecting a plurality of sub images corresponding to 
the main image ("marking of regions of interest" at paragraph 0017, line 6) and extracts 
medical images related to the main image from at least one of the medical images 
generated by the at least one modality and the medical images stored in the managing 
device on the basis of the accompanying infomnation (Table 1 ). 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to modify the display of Wang and Takeo using the user interaction taught 
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by Bodicker as described above, to allow the user to choose which diagnostically 
relevant information to view. 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Katrina Fujita whose telephone number is (571) 270- 
1574. The examiner can normally be reached on M-Th 8-5:30pm, F 8-4:30pm, 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor. Brian P. Werner can be reached on (571) 272-7401. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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